Recent #AI Training news in the semiconductor industry

6 months ago
➀ Microsoft is accused of scraping user-generated content from Word and Excel to train its AI models; ➁ The 'Connected Experiences' feature is enabled by default and requires specific settings to opt-out; ➂ Microsoft denies using customer data for AI training, stating the feature is for internet-required functions like document co-authoring.
AI TrainingConnected ExperiencesData privacyExcelMicrosoftWord
10 months ago
1. Meta's Llama 3 405B model training on 16,384 NVIDIA H100 GPUs experienced half of its failures due to HBM3 memory issues. 2. The 54-day training run encountered 419 unexpected component failures, averaging one every 3 hours. 3. Meta's team improved efficiency with proprietary diagnostic tools and managed 90% effective training time despite disruptions.
AI TrainingGPU ClusterHBM3 Memory